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ABSTRACT 

We introduce a hierarchical class of approximations of the random Ising spin glass in d 
dimensions. The attention is focused on finite clusters of spins where the action of the rest 
of the system is properly taken into account. At the lower level (cluster of a single spin) 
our approximation coincides with the SK model while at the highest level it coincides with 
the true (i-dimensional system. The method is variational and it uses the replica approach 
to spin glasses and the Parisi ansatz for the order parameter. As a result we have rigorous 
bounds for the quenched free energy which become more and more precise when larger 
and larger clusters are considered. 

PACS NUMBERS: 05.50.+q, 02.50.+S 
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1. Introduction 

Research around spin glasses in finite dimensions is very active since it is still unclear if 
they share all the qualitative features of the mean field model (SK). Since a direct study of 
these systems is quite complicated both from a numerical and an analytic point it could be 
of some interest to consider corrections to the SK model which partially take into account 
of the dimensionality. Our aim is to find out a systematic and rigorous way to introduce 
these corrections. As a result, we generate a class of models which interpolate between the 
mean field SK model and exact spin glasses in finite dimensions. Our approach uses the 
replica formalism together with the celebrated Parisi ansatz for the order parameter. 

The standard replica approach to the SK model reduces the problem to a single spin 
whose replicas interact via the variational order parameters {q ab } that can be thought as 
'coupling fields'. This is the analogue of what one has for the mean field model of the 
ordinary ferromagnetic Ising systems. In this second case, in fact, one has a single spin in 
a magnetic field generated by the rest of the system. 

Both models, SK and mean field Ising model, can be regarded as an approximation 
of the associated Ising system in finite d dimensions, but in both cases any reference to 
the dimensionality is lost. The approximation can be improved and a memory of the 
dimensionality can be maintained if, in spite of considering a single spin in a bath, one 
focus the attention on a cluster of interacting spins in a bath generated by the rest of the 
system. The strategy, which is very successfully applied for ordinary spin systems (Bethe- 
Peierls approximation has been recently extended to spin glasses [0-0. Actually 

the approach of @-[|) turns out to be not too much effective, since it does not allows for a 
study of the replica symmetry breaking. This fact reduces the scope of the method to low 
dimensional spin glasses, while for d > 3 dimensions it fails in describing the most striking 
feature of these systems. 

In this paper we introduce a new approach which allows for symmetry breaking. The 
attention is focused on finite clusters of spins where the action of the rest of the system is 
properly taken into account. The approximations we obtain are organized hierarchically 
according to the size of the clusters. At the lower level (cluster of a single spin) our 
approximation coincides with the SK model while at the highest level it coincides with 
the true (i-dimensional system. The method is variational and it uses the replica approach 
to spin glasses and the Parisi ansatz for the order parameter. As a result we have rigorous 
bounds for the quenched free energy which become more and more precise when larger 
and larger clusters are considered. 
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Let us briefly sum up the contents of the paper. 

In section 2, we introduce the model and we generalize the standard replica approach 
in order to take advantage from the cluster partition of the lattice. 

In section 3, we derive the new variational approach and we find out analytic lower 
bounds of the free energy of the <i-dimensional spin glass. 

In section 4, we choose the Parisi ansatz in order to obtain a computable solution 
of the problem. In particular, we write down the free energy in the case of k symmetry 
breaking. 

In section 5, we test our method against of the case of a plaquette of four spins in d = 2 
dimensions; the free energy and the order parameter are obtained at all the temperatures 
for the replica symmetry and one symmetry breaking solutions. 

In section 6, we discuss some aspects of our approach which seems to be useful for 
improving usual Monte Carlo simulations for spin glasses in finite dimensions. 



2. New look at the replica approach 

We consider Ising spin glass models with nearest neighbours interactions on a d- 
dimensional lattice of N sites. The hamiltonian is 

H = t- \ J; jfJiCTj 

(2d) 3 frf. hJ 3 

where the {o~i = ±1} are the N spin variables and the {Jij} are the dN independent 
normal gaussian random variables (zero mean and unitary variance). The sum runs on all 
the dN nearest neighbours sites 
The partition function reads 

M 

where (3 is the inverse temperature. The quenched free energy is 
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where ~ indicates the average over the disorder variables {Jij}- Indeed, almost all the 
disorder realizations have the same free energy in the thermodynamic limit N — > oo. 



Unfortunately, it is not possible to find out an explicit expression of (|2.1j ) in terms 
of simple functions because of the presence of the logarithm in the disorder average. The 
standard replica approach || tries to avoid this difficulty replacing the above quenched 
average with the annealed average of the n-th power of the partition function Z with 
integer n. In fact, if the result can be analytically continued to real n, one has 

/d = -lim lim — — lnZ» (2.2) 
The average over the gaussian disorder variables gives 

= exp { \fNn\ Eexplg^X: \ (2-3) 

L } {a} { (i,j)a<b J 

where cr" is the a-th replica of the spin in the i-th site. 

Unfortunately, even in the replica context the free energy can be computed only in 
the infinite dimension limit. In this case, in fact, one reduce to the celebrated SK model 
HI, and one has 



/. = - P - + Hm - max 

4 n^O fl {q ab } 



a<b 



iln ^exp|/3 2 ^^Va b l 

^ {a} { a<b J 



(2.4) 



where q ab is a real matrix. In the limit n — >• this maximum is found following the Parisi 
ansatz ]7|-|9|]. When d is finite, no analogous results are available, so that it is sensible to 
look for approximations as the one in this paper. 

All the above expressions are so classical that it could appear completely useless to 
have reproduced them here, indeed, the reason is that we would like to recast them in a 
more general form introducing the notion of cluster partition of the set of the N spins. 
The new formulation, which is more general and provides the technical ingredients for our 
variational approach, reduce to the standard replica trick in the case of clusters of a single 
spin. 

To have an idea of the clusters we have in mind think to a plaquette of four nearest- 
neighbours spins in two dimensions, or a cube of eight spins in three dimensions. In general, 
we perform a decomposition of the set of the spins into clusters of the same shape, such 
that each spin belongs to one and only one of them. In the following we indicate with 
(i, j) all the couples of nearest-neighbours sites that belong to the same cluster, and with 
~ the disorder average over the couplings between them. In the same way denotes 
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all the nearest-neighbours sites of different clusters, and ~ the related disorder average. 
Finally, (i) runs only over the boundary sites of all the clusters. Moreover, the following 
definitions are useful 

n a = number of spins in a cluster 
rib = number of boundary spins in a cluster 
rij = number of bonds in a cluster 



which imply that ^ is the total number of clusters in the system, and that 



w 



For instance, in fig. |T| one has clusters of n a = 12 spins, with = 8 boundary spins 
and rij = 16 internal bonds per each cluster. 

Than, we compute again the free energy with the replica trick, but this time we 
perform the annealed average only over those bounds that couple different clusters: 
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fd = - lim lim In Z n (2.5) 

J N^oo n^O [3Nn K ' 



Somehow, this expression interpolate between ( |2.2j ) which corresponds to clusters of a 
single spin (no couplings inside the clusters) and the quenched expression (|2.1|) which 
correspond to a single cluster of size of order iV spins. 
An easy calculation gives 

Z^" =exp ji^A^l- -^-^) j ^exp{-/3tf (n) } (2.6) 



where 



H(n) = - E j« t - 1 E E <°\°"A (2-7) 

Remark that the first sum, which runs on internal couplings, disappears when the clusters 
are of a single spin. In this case ( |2.6| ) and ( |2.7| ) reduce to (|2.3|). 
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3. The variational approach 

Let us start by only considering clusters where all boundary spins are topologically 
equivalent, as for example a d- dimensional hyper-cube of 2 d spins, or the crosses shown in 
fig. [I] on a two-dimensional lattice. 

We now introduce a trial hamiltonian instead of H^- n \ where the first term 

related to the interactions between spins of the same cluster is left unchanged, while the 
second is modified with the replacement 
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a i a j a j ~^ 9 y^i^i + <7j<7j) (3.1; 



where the {q ab } are a set of variational parameters of the problem. Let us recall that i 
and j are a couple of boundary sites of different clusters. The intuitive meaning of our 
approximation is clear: the coupling field {q ab } simulates the action of the rest of the 
system over a the boundary of a cluster in the replica space. Remark that now the spins 
on the boundary of different cluster do not interact, so that the total hamiltonian is the 
sum of the hamiltonians of each cluster. Therefore, with the replacement (|3.1| ), the new 
hamiltonian has the form 

ifW = n c iust {n) (3.2) 

dust 

with 

1 dust n q dust 

= - «55I £ J «5>W -£("»- t) £ ^>° V?ff - (3 ' 3) 

\ M >* (iJ y «=i " (j) < „<(, 

i ,i \—\dust i \—\dust , • i ,i • , i , • i 

where now the sums 2-jU jy and 2-iuy run over, respectively, the internal nearest neigh- 
bours bonds and the boundary sites of a single cluster. 

Using the convexity of the exponential, the following inequality holds for any integer 
n > 1: 



ln^exp{-/3#W} = m(e-^ ( " ) -^ ( ™ ) )) + ln^exp{-#ffW} > 

M M 

(3.4) 



> max 
{q ab } 



-P(H( n ) - #(»)) + ln^exp{-/3#H} 



where the (•) indicates the average over the Gibbs measure induced by the hamiltonian 
Since the sites i and j belong to different clusters, one has 

/ / / ,2 

(3.5) 



where the indices have been suppressed because of the equivalence of boundary spins. As 
a consequence one can write the simple expression 
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nj 



,2 



( (° a ° b } - 2 q ab {(r a a b ) 

a<b 



2' V dn a 



The maximum in the right hand side of ( |3.4| ) can be found deriving it respect to 
each q ab , so that after some trivial algebra one has the following system of hn(n — 1) 
self-consistent equations 



,ab 



(a a a b ) 



1 < a < b < n 



(3.6) 



The right hand side of ( |3.4| ) is the maximum of an expression containing averages with 
respect to the Gibbs measure which are quite complicated. Fortunately, a more simple and 
compact expression exists which has the same maximum in the same point corresponding 
to the solution of (|3.6|). This expression is 



~\p 2 N (l - $> a6 ) 2 + ln^exp{-^H} (3.7) 

^ H ° ' a<b {a} 

Therefore, (3"77) can be used to replace the one into the square parenthesis in the right 
hand side of (3^). Then, taking in mind that is an hamiltonian fully decomposed 

into the hamiltonians fi c /ust corresponding to the different clusters, it is possible to 
perform the thermodynamic limit and then the limit n — > 0. In doing this second limit one 
has to be careful since the inequality ( |3.4j ) has been established for integer n > 1 and it 
changes direction when we perform the analytic continuation to real n < 1. In conclusion, 
one has 

fd > Id (3.8) 



with 



fd 



4n 



nj 
d n n 



+ 



+ lim — max 

n^o n {q ab } 



1 - 



nj_ 

d n a 



a<b 



b\2 



(3n c 



ln^exp{-/30W} 



(3.9) 



7 



where Q*- n ) is a representative hamiltonian of a single cluster. 

Before ending this section we would like to stress that (|3.9| ) , derived for clusters where 
the boundary spins are topologically equivalent, can be easily extended to a generic clus- 
ter decomposition of the lattice (see Appendix). In this case to every boundary spin Oi 
is associated a different qf b and the maximization can become very complicated. Never- 
theless, ( p.8|) and ( |3.9| ) with a single q ab still hold although fd is not anymore the optimal 
approximation. The maximum is reached when 

b w 

Let us briefly sum up the results of this section. We have found lower limits fd for the 
quenched free energy fd of a spin glass in d dimensions via the replica formalism. The free 
energies fd approximate better and better the fd when the size of the cluster increases. The 
structure of the solution is familiar, since we have to compute a maximum of a function 
which depends on a set of \n{n — 1) variational parameters in the limit n — > 0. 

Notice that fd turns out to be a generalization of the expression ( |2.4j ) for the SK 
model free energy f^. In fact, independently of the dimension d, fd reduces to ( |2.4[ ) when 
one chooses a cluster of a single spin. The proof is trivial since in this case one has n a = 1, 
rib = 1 and nj = so that the first term in the hamiltonian if( n ) vanishes. This fact is 
quite interesting since it implies that the well-known expression ( |2.4f) for the SK model 
free energy represents in our scheme, so to speak, the zero-order approximation of the 
random Ising spin glass in finite dimensions. 

It also should be remarked that in the limit d —>■ oo, independently on the size of the 
clusters, one reduces to the SK model. 

4. Replica symmetry breaking with the Parisi ansatz 

It is quite simple to show that in the SK model, for any integer n > 1, the maximum 
in ( p.4|) is reached when all the q ab assume the same value 

q ab = q l<a<b<n (4.1) 

with qo > 0. This is the replica symmetry solution, but unfortunately it turns out to be 
unstable and unphysical in the limit n — > (for example, it has a negative zero temperature 
entropy) . 



8 



Parisi has proposed a simple way [0-0 to broke the above symmetry between the n 
replicas. His choice is at the first stage to organize them in groups of mi replicas, 
and to assume a q ab with two different values. The larger value corresponds to a and 
b belonging to the same group, and the smaller one to a and b in different groups. This 
strategy can be iterated repeating the same procedure for each group and all its subgroups, 
so that the k-th order breaking can be written as 

b 



Qs 



if 





a 




f 


_m s _ 








a 






m s+1 _ 



m. s 



m s+1 



with 




(4.2) 



where [•] means integer part. All the {q s — <? s -i} are assumed to be non-negative and it 
also assumed mo = n and rrik+i = 1. 

The above Parisi ansatz is straightforward for integer n if all the {m s } and the { } 
can be chosen as integers. The intriguing point is that, after the analytic continuation to 
real n in the limit n — > 0, the {q s ,m s } are treated as a set of 2k + 1 real variational 
parameters with the constraint 

< . . . < m s < m s+ i < . . . < m,fc + i = 1 

This constraint allows for a well-defined overlap probability. We recall that it is sufficient 
to use few symmetry replica breaking (say k = 2) to achieve a solution of the SK model 
with realistic behaviours (such as, T = free energy consistent with numerical simulations, 
or T = non-negative entropy). 

The ansatz ( |4.2| ) can be easily adapted to our more general fd- The main difference 
with the SK model is the presence of the coupling terms in the hamiltonian fi( n ), but they 
do not mix different replicas, so that the usual steps used for solving the SK model can be 
repeated. Recalling the well-known trick of the Gaussian integral, the solution of fd with 
k > breaking can be written as 

k 

l-q k ) 2 + Y^ m s(Q 2 s-i-Q 2 s) )+fk (4-3) 



fd,k 



max 

{q s ,m B } 



4 



1 - 



nj 



d n r 



with 



fk 



s=l 



-hi 1 ) 



-jM 0) 



1 

f3n a m\ 



In 



(4.4) 
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J2?M-PH k } (4.5) 



and 



^ dust 
= — . i / ^ Ji,jO-i(Tj + 



n 6 2 




(4.6) 



Each of the k + 1 averages {~ } (0 < s < fc) contains n& independent normalized 
Gaussian fields {^^} acting only on the boundary spins of the cluster. The set {h^} is 
the only one to appear in a quenched average ~ J ' h,( ' } together with the n 7 random couplings 



{Jij} internal of the cluster. Notice that in the hamiltonian (|4.6|) we have replicated only 
the n a spin variables of the cluster. 

Equations (|4.3| ) - ( f4.6|) have the same structure of the Parisi solution of the SK model 
with k replica symmetry breaking, except for a more general form of H k . In particular, 
the Parisi solution for the SK model can be recovered, independently on the dimension 
d, choosing a cluster of a single spin. For a larger cluster the Parisi solution only can be 
recovered when d — *■ oo. In both cases, in fact, the first sum in Q4.6| ) disappears, and the 
factor in front of the second sum equals one. 

It is worth interesting that the dependence of the solution from the number of di- 
mensions d is purely algebraic, once the shape of the cluster is fixed, so that the same 
algorithm holds for every dimension d, which plays only the role of a parameter. 



5. An application in d = 2 dimensions 



We check our method in d = 2 dimensions choosing the elementary plaquette of four 
nearest neighbours spins as the cluster, so that n a = = nj = 4. With this choice the 
replica symmetry solution ( (|4.3Q - Q4.6|) with k = 0) reads: 



f = max 

90 



^ ln£exp{-/?ff„} 



J,h 



(0) 



M 



(5.1) 



with 



4 ^4 



i=l 



i=l 
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while the solution with one replica breaking (k = 1) is: 



fi = max 

{qo,qi,m} 







((l-ft) 2 +«»(9S-d))-^ln 



J2*M-PHi} 



■J,h 



(0)' 



(5.2) 



with 



1 4 

H i = — - ^ JiOiOi+i 



22 



i=l " i=l 

It is obvious that (|5.2| ) reduces to (5.1) when qi = go and m = 0. The maximum in 
( |5.1|) and (|5.2| ) can be found out using standard numerical methods. For instance, deriving 
( |5.2|) with respect to {go, Qi, wi}. one can write down a set of self-consistent equations which 
can be solved numerically. 

The result is that the order parameters differ from below a critical temperature 
T cr ~ 0.86, that is sensibly lower of the corresponding one of the SK model (T cr = 1). 

In fig. |] we plot the free energies fo and fi as a function of the temperature T in the 
range < T < T cr . They are compared with the SK results and with the free energy of 
an isolated plaquette with gaussian couplings and no boundary fields. Our free energies 
show a certain improvement respect to the SK ones from a quantitatively point of view, 
while the isolated plaquette badly describes the systems below the temperature T = 0.7. 

In fig. ||-a and fig. |)-b are plotted, respectively, the go, Qi and the m order parameters of 
the one breaking solutions, as a function of the reduced temperature T/T cr . The qualitative 
behaviors are very similar to the SK corresponding parameters. 



6. Conclusions 

Let us start this paragraph by a technical remark about the implementation of an 
algorithm able to find the maximum in ( [4.3| ). The expression ( |4.4[ ) for suggests that 
the number of breaking k is the main source for the algorithmic complexity. In fact, one 
has to compute first a quenched average over nj + Gaussian variables (the J's and the 
fr(°)'s); then an average over other rib variables (the /i^'s), and so on. Using MonteCarlo 
algorithms this leads to a computing time t for f^ st proportional to 

t ~ (raj + n b ) n\ 
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so that a unitary growth of the breaking number corresponds to a big growth of t which is 
amplified of a factor n^. On the contrary t only has a polynomial dependence on rij and 
rib, so that it is less difficult to increase the size of the cluster. Finally, the dimension d is 
not significative, since the complexity of the algorithm does not depend on d. 

A second remark is that the hamiltonian ( |4.6| ) and the free energy ( |4.3| ) in case of 
replica symmetry correspond to a single replica spin glass of finite size with gaussian 
magnetic fields at the boundary. The variance has to be chosen in order to feign at the 
best the action of the rest of the system (a similar approach has been proposed by Hatano 
and Suzuzi (||10||-|[11||), where the variance is fixed by a self-consistent equation). 

For these two reasons we believe that our approach could be used to improve the 
numerical simulations of spin glasses. In fact, the numerical approach tries to understand 
the properties of spin glasses in thermodynamical limit using finite size systems, i.e. finite 
clusters with periodic boundary or open conditions. In our replica symmetry context we 
save this scheme but we can take into account more carefully of the action of the rest of the 
system without increasing too much the computing time. The ordinary numerical study 
chooses zero variance of magnetic field at the boundary, while we have a variance which 
can be optimized. In conclusion, one should: 

1) consider the finite size system and apply gaussian fields of variance go at the bound- 
ary; 

2) compute numerically the free energy and the overlap for various values of qo] 

3) choose qo in order that it equals the overlap ^ Yl{i}' (notice that qo = 
would correspond to the standard numerical study with open boundaries). 

Investigations about this numerical strategy are actually in progress. 
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Appendix A. 

In this appendix we derive a generalization of formulae (|3.8| ) and ( |3.9|) for the more 
general case of a full decomposition of the lattice in equal clusters with no topological 
equivalence of boundary sites. 

For instance, think to a square cluster of L 2 sites in d = 2 dimensions. First of all, 
the corner sites have two external bonds at variance with the unique external bond of the 
other boundary sites. Furthermore, the external location of the site along the boundary 
also determine the strength of the interaction with external spins. For these reasons, in 
general, the averaged overlap (erf erf) depends on the boundary site i, and ( |3"1)| ) does not 
hold anymore. It follows that we have to modify the replacement rule ( |3.1|) in order to 
take into account the topological differences between the various boundary spins. 

The boundary sites can be grouped in rib classes; each class consists of ^- topologically 
equivalent sites, one per cluster. We focus the attention on a given cluster (the reference 
cluster), so that its n& boundary sites (k) are to be the representative elements of each 
class. Then, we introduce the function k(i) which associate the generic boundary site i 
to its representative of the reference cluster. Two sites of the reference cluster, say k(i) 
and k(j), are 'adjoint nearest neighbours' if the couple i,j belongs to the set , and 

(k — ► k) indicates all the adjoint nearest neighbours k of the site k. 

At this point is straightforward to replace q ab with a set of n& parameters {q% }, one 
per each representative k site. The total number of variational parameters is, therefore, 
?fn(n- 1). 

The replacement rule (|3j]) for a couple of boundary sites can be now generalized as 
follows: 

^o- a b . ab „a _b i „ab a h { A i\ 

In other words, each replaced external interaction leaves a different memory. 
With the replacement ( |A.1| ) the hamiltonian of a cluster reads 

1 dust n „ dust 

^ ' a=1 a < b {%)' (k^k(i)) 

and the averaged overlaps of two boundary sites of different clusters are 

(<r?o*<rfo*) = (ofo*) (<rfo*) = (* a k{l) cr b k{t) ) (°l u f b m ) 
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Formula ( j3.4|) still holds for any integer n > 1, so that 



lnY^ exp{-3H( n n > max 

{a} iQk i 



-(3(H( n ) - ffW) + In ^exp{ 

M 



(A.3) 



where 



4<i rj-o- 



Kd (fe)' (fc— fc) 

The maximum in the right hand side of ( |A.3|) can be found by solving the following 
system of ^n(n — 1) self-consistent equations 



E "t = E <°M> 



1 </c < 
1 < a < b < n 



(A.4) 



and the expression to be maximized in ( |A.3| ) can be replaced by the following expression 
which has the same maximum in the same point: 

R 2 N ' 

-sf EE*° 6 E «f + in E 

Finally, the analytic continuation to real n — > gives 

/d > fd 



(A.5) 



with 



+ lim — max 

n^o n {q% b } 







EE** 6 E ^-^ ln E-p{-^ (ri) } 



a a<b (k) ' {ct} 



(A.6) 



Notice that the {q^ 6 } are not all different if there are symmetric sites in the clusters. For 
example, the sites on the four corners of a square plaquette in d = 2 dimensions will share 
the same overlaps. 

Finally, if we look for the maximum of (|A.6|) with the constraint 



q ab = Q at 



V k = l,...,n & 



we reduces to formula (|3.9|). Therefore, in this context, ( |3.9| ) is a worse approximation, 
except all the boundary sites of the cluster are topologically equivalent. 
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Figure Captions 

Fig. 1. Decomposition of a two-dimensional spin lattice in clusters of n a = 12 spins, with 
rib = 8 boundary spins (white circles), 4 internal spins (black circles) and nj = 16 
internal bonds (full lines) per each cluster. The dashed lines represent the bonds 
between spins belonging to different clusters. 

Fig. 2. Free energy as function of the temperature T in d = 2 dimensions: replica sym- 
metry and one breaking solutions for the four spins plaquette (dashed lines), SK 
replica symmetry and SK one breaking (dot-dashed lines), single plaquette (full 
line) with no boundary fields (q ab = 0) . The vertical bars represent the numerical 
error on the one breaking solution for the plaquette. 

Fig. 3. Order parameters for the four spins plaquette in d = 2 dimensions, as function 
of the reduced temperature T/T cr : a) replica symmetry q and one breaking qi ; 
b) one breaking m. 
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